• When should you fix data quality at the source instead of adding transformation step?

    A common challenge in analytics is dealing with inconsistent formats, duplicate records, missing values, and mismatched definitions across systems. Transformation tools can standardize much of this, but repeated fixes can turn into a growing collection of exceptions and workarounds.At some point, it becomes worth asking whether the pipeline is solving the problem or simply compensating(Read More)

    A common challenge in analytics is dealing with inconsistent formats, duplicate records, missing values, and mismatched definitions across systems. Transformation tools can standardize much of this, but repeated fixes can turn into a growing collection of exceptions and workarounds.
    At some point, it becomes worth asking whether the pipeline is solving the problem or simply compensating for it.
    For those working with ETL, Alteryx, SQL, or Python pipelines, what tells you that a transformation belongs in the pipeline versus being a problem that should be fixed in the source system?
    How do you handle it when the source team cannot make changes?

  • When should you fix data quality at the source instead of adding transformation step?

    A common challenge in analytics is dealing with inconsistent formats, duplicate records, missing values, and mismatched definitions across systems. Transformation tools can standardize much of this, but repeated fixes can turn into a growing collection of exceptions and workarounds. At some point, it becomes worth asking whether the pipeline is solving the problem or simply(Read More)

    A common challenge in analytics is dealing with inconsistent formats, duplicate records, missing values, and mismatched definitions across systems. Transformation tools can standardize much of this, but repeated fixes can turn into a growing collection of exceptions and workarounds.
    At some point, it becomes worth asking whether the pipeline is solving the problem or simply compensating for it.
    For those working with ETL, Alteryx, SQL, or Python pipelines, what tells you that a transformation belongs in the pipeline versus being a problem that should be fixed in the source system?
    How do you handle it when the source team cannot make changes?

  • Facebook Ads Insights API Error: Missing Capability?

    I’m trying to fetch data from the Facebook Ads Insights API, but every request returns the following error: { “error”: { “message”: “(#3) Application does not have the capability to make this API call”, “type”: “OAuthException”, “code”: 3 } }   The app has a valid access token, and I can successfully make requests to(Read More)

    I’m trying to fetch data from the Facebook Ads Insights API, but every request returns the following error:

    {
      "error": {
        "message": "(#3) Application does not have the capability to make this API call",
        "type": "OAuthException",
        "code": 3
      }
    }
     

    The app has a valid access token, and I can successfully make requests to other Facebook Graph API endpoints.

    Example request:

    GET https://graph.facebook.com/v2.8/act_<AD_ACCOUNT_ID>/insights
      ?fields=impressions,clicks,spend
      &access_token=<ACCESS_TOKEN>
     

    Has anyone encountered this issue with the Insights API specifically?

    I’m wondering if this is related to:

    • Missing app permissions
    • App review requirements
    • Ads API access approval
    • Business Manager configuration

    What was the actual fix in your case?

  • Can Alteryx rerun a workflow when a file changes?

    I’m working with Alteryx and have a workflow that processes data from an Excel/CSV file. Right now, every time the source file is updated, I have to manually rerun the workflow. I was wondering if there’s a way to have Alteryx automatically detect changes to the input file and rerun the workflow, or if I(Read More)

    I’m working with Alteryx and have a workflow that processes data from an Excel/CSV file. Right now, every time the source file is updated, I have to manually rerun the workflow.

    I was wondering if there’s a way to have Alteryx automatically detect changes to the input file and rerun the workflow, or if I need to use something like Alteryx Scheduler, Windows Task Scheduler, or another workaround.

    Has anyone implemented something similar? What approach worked best for you?

    This keeps the question:

    • Natural and Reddit-like.
    • Focused on one problem.
    • Open-ended enough to invite discussion and different solutions.
  • How can I run tsc –watch and nodemon together using npm scripts?

    Hi everyone, I’m learning Node.js with TypeScript and I’m trying to improve my development workflow. Right now, I compile my TypeScript files and then manually restart the server whenever I make changes. I was wondering if there’s a way to use npm scripts to run both the TypeScript compiler in watch mode and nodemon at(Read More)

    Hi everyone,

    I’m learning Node.js with TypeScript and I’m trying to improve my development workflow. Right now, I compile my TypeScript files and then manually restart the server whenever I make changes. I was wondering if there’s a way to use npm scripts to run both the TypeScript compiler in watch mode and nodemon at the same time.

    My current package.json scripts look like this:

     
    {
      "scripts": {
        "build": "tsc",
        "start": "node dist/index.js",
        "dev": "tsc --watch"
      }
    }
     

    I’d like to automatically recompile my TypeScript files and have nodemon restart the server whenever the compiled JavaScript changes. Is there a recommended way to do this using npm scripts, or should I use another tool like concurrently or npm-run-all?

    I’m still learning, so I’d appreciate a beginner-friendly explanation. Thanks!

Loading more threads